Configuration mechanisms in a switchless network

ABSTRACT

A processor initiates an execution of a network driver in a first node comprising a master node of a plurality of nodes in a switchless network. The network driver configures the plurality of nodes and service level in the switchless network by transmitting management datagrams from the master node, wherein the management datagrams include an attribute that allows the management datagrams to be propagated among the plurality of nodes of the switchless network without being terminated at host channel adapters of the plurality of nodes.

BACKGROUND 1. Field

Embodiments relate to a method, system, and computer program product for configuration mechanisms in a switchless network.

2. Background

In a computer network a plurality of devices may communicate with a plurality of other devices. In many situations the devices are interconnected via a plurality of switches, where a switch is a computer networking device that connects the plurality of devices together in a computer network, by using packet switching to receive, process and forward data from a source device to the destination device via zero or more intermediate devices. Therefore, the switches may logically configure communication links between the plurality of devices with physical links being located between the switch and each device. Such a network that uses switches may be referred to as a switched computer network.

In contrast, in switchless computer networks, the plurality of devices are connected via dedicated links that do not includes switches. A device may receive a packet from one device and forward the packet to another device. As a result, a source device may be able to communicate with a destination device in switchless computer networks via one or more intermediate devices.

A subnet is a logical, visible subdivision of an Internet Protocol (IP) network. The practice of dividing a network into two or more networks is called subnetting. Computers, devices, and/or nodes that belong to a subnet are addressed via a common, identical, most-significant bit-group in their IP address. In a packet switched network (e.g., an IP network), a datagram is a basic data transfer unit. A datagram may be a self-contained, independent entity of data carrying sufficient information to be routed from the source to the destination computer without reliance on earlier exchanges between the source and the destination computer and the transporting network. The delivery, arrival time, and order of arrival does may not have to be guaranteed by the packet switched network.

InfiniBand* is a computer-networking communications standard that may be used in a computer network for communication among a plurality of devices. Further details of InfiniBand may be found in the publication “InfiniBand Architecture, Specification Volume 1, Release 1.3”, published Mar. 3, 2015 by the InfiniBand Trade Association and the publication is hereinafter referred to as the “InfiniBand standard”. The InfiniBand standard provides further descriptions for formats associated with datagrams, subnets, and other entities of a packet switched network. The InfiniBand standard defines a format for management messages which supports common processing, where the management messages are referred to as management datagrams (MAD). Each management datagram contains the same header format that identifies the class of a management message and the method. In the InfiniBand standard, the management datagrams used for administration of a subnet are described. Subnet administration uses particular formats for management datagrams, and such management datagrams are referred to as subnet administration management datagrams. * IBM, zSeries, pSeries, xSeries, BladeCenter, WebSphere, and DB2 are trademarks of International Business Machines Corporation registered in many jurisdictions worldwide.*InfiniBand is a registered trademark of the InfiniBand Trade Association.

SUMMARY OF THE PREFERRED EMBODIMENTS

Provided are a method, a system, and a computer program product in which a processor initiates an execution of a network driver in a first node comprising a master node of a plurality of nodes in a switchless network. The network driver configures the plurality of nodes and service level in the switchless network by transmitting management datagrams from the master node, wherein the management datagrams include an attribute that allows the management datagrams to be propagated among the plurality of nodes of the switchless network without being terminated at host channel adapters of the plurality of nodes.

In additional embodiments, the configuring further comprises assigning addresses to each of two sides of a link, and using port-specific management information to match link parameters and set addresses.

In yet additional embodiments, the configuring further comprises setting parameters for managing the service level, and moving links to active state by using the port-specific management information.

In further embodiments, in response to completion of the configuring of the plurality of nodes and the service level, applications start working in the plurality of nodes.

In yet further embodiments, the port-specific management information comprises a PortInfo attribute in an InfiniBand standard.

In certain embodiments, the setting of the parameters for managing the service level in an InfiniBand network further comprises setting virtual lane arbitration tables, and setting service level to virtual lane mappings.

In further embodiments, the management datagrams are associated with subnet administration in an InfiniBand network.

BRIEF DESCRIPTION OF THE DRAWINGS

Referring now to the drawings in which like reference numbers represent corresponding parts throughout:

FIG. 1 illustrates a block diagram of a computing environment comprising a plurality of nodes coupled in a switchless network, in accordance with certain embodiments;

FIG. 2 illustrates a block diagram of a management datagram, in accordance with certain embodiments;

FIG. 3 illustrates a flowchart that shows the configuring of an attribute of a management datagram for transmission across a plurality of nodes in a switchless network, in accordance with certain embodiments;

FIG. 4 illustrates a flowchart that shows operations performed on receiving an attribute of a management datagram in a switchless network, in accordance with certain embodiments;

FIG. 5 illustrates a flowchart that shows the configuring of an attribute of a management datagram for transmission across a plurality of nodes in a switchless network, in accordance with certain embodiments;

FIG. 6 illustrates a block diagram that shows exemplary subnet management attributes in a switchless network, in accordance with certain embodiments;

FIG. 7 illustrates a block diagram that shows service level attributes, service level to virtual lane mappings, and associated table in a switchless network, in accordance with certain embodiments;

FIG. 8 illustrates a flowchart that shows configuration mechanisms in a switchless network;

FIG. 9 illustrates a flowchart that shows further configuration mechanisms in a switchless network;

FIG. 10 illustrates a block diagram of a cloud computing environment, in accordance with certain embodiments;

FIG. 11 illustrates a block diagram of further details of the cloud computing environment of FIG. 10, in accordance with certain embodiments; and

FIG. 12 illustrates a block diagram of a computational system that shows certain elements that may be included in one or more nodes, as described in FIGS. 1-11, in accordance with certain embodiments.

DETAILED DESCRIPTION

In the following description, reference is made to the accompanying drawings which form a part hereof and which illustrate several embodiments. It is understood that other embodiments may be utilized and structural and operational changes may be made.

The discovery and configuration of InfiniBand networks may be performed by using subnet manager protocol (SMP) direct routed management datagrams (MAD) that specify source to destination routes, and further details may be found in Chapter 15 (“Subnet Administration”) of the publication “InfiniBand Architecture, Specification Volume 1, Release 1.3”, published Mar. 3, 2015 by the InfiniBand Trade Association. In current InfiniBand networks, the transmission of such management datagrams may be terminated at host channel adapters (HCA) in a switchless network, and as a result the management datagrams cannot be propagated from node to node. In switched networks, the switches manage and forward the management datagrams which allows the transmission of such management datagrams between any pair of ports in the network.

Certain embodiments describe a method, system, and computer program for configuring an attribute for propagating management datagrams in a switchless network that may comprise an InfiniBand network. In such embodiments the transmission of the management datagrams is not terminated at host channel adapters. Certain embodiments describe a method, system, and computer program for configuring a fabric comprising a plurality of nodes in a switchless network that is implemented in conformance with the InfiniBand standard.

Exemplary Embodiments

FIG. 1 illustrates a block diagram of a computing environment 100 comprising a plurality of nodes 102, 104, 106, 108 that are coupled in a switchless network, in accordance with certain embodiments. While in FIG. 1 only four nodes 102, 104, 106, 108 are shown, in alternative embodiments there may be a fewer or a greater number of nodes.

Each node may comprise any suitable computational device including those presently known in the art, such as, a personal computer, a workstation, a server, a mainframe, a hand held computer, a palm top computer, a telephony device, a network appliance, a blade computer, a processing device, a controller, etc. The nodes may be elements in any suitable network that is switchless. The switchless network is a network that does not rely on switches to direct or transmit packets. In certain embodiments, the nodes 102, 104, 106, 108 may be elements in a cloud computing environment.

The plurality of nodes 102, 104, 106, 108 may each include a host channel adapter (HCA) that may in certain embodiments comprise a peripheral component interconnect (PCI) card. The host channel adapter is hardware that allows packets to be received and transmitted in the switchless network. In FIG. 1, four representative host channel adapters 110, 112, 114, 116 are shown. The host channel adapters 110, 112, 114, 116 may include a plurality of ports, such as ports 118, 120, 122, 124, 126, 128, 130, 132. In FIG. 1, port 118 is shown in communication with port 122, and port 124 is shown in communication with port 126. In certain embodiments, the communication between any two ports is controlled via software implemented network drivers 134, 136, 138, 140, and other software implemented applications such as the discovery and configuration application 142 in the computing environment 100. The network drivers 134, 136, 138, 140 may interface with the host channel adapters 110, 112, 114, 116.

Managements datagrams 144, 146, 148, 150, 152, 154 may be used to transmit data from node to note in the switchless network of the computing environment 100. The control, configuration, and management of the management datagrams 144, 146, 148, 150, 152, 154 may be performed by at least the network drivers 134, 136, 138, 140 and the discovery and configuration application 142. While only one discovery and configuration application 142 has been shown in the first node 102, other nodes may also have similar applications.

In FIG. 1, the discovery and configuration application 142 in coordination with the network driver 134 configures the management datagram 144 for sending via port 118 of the host channel adapter 110. The management datagram 146 (corresponding to management datagram 144) is shown being transmitted from port 118 of the host channel adapter 110 of the first node 102, to port 122 of the host channel adapter 112 of the second node 104. Similarly management datagram 150 may be sent from the second node 104 to the third node 108. In certain embodiments, attributes in the management datagrams are configured such that a management datagram may be transmitted across a plurality of nodes, without the transmission being terminated on receipt of the management datagram by a host channel adapter of a receiving node.

FIG. 2 illustrates a block diagram of a management datagram 200, in accordance with certain embodiments. In certain embodiments, each management datagram is configured to include an attribute 202 that may also be referred to as a ProxyMADcommand attribute. In certain embodiments, the ProxyMADcommand attribute is configured to allow management datagrams to continue transmission across the host channel adapter of a receiving node.

In certain embodiments, to implement the ProxyMADcommand attribute, a custom modifier of an existing attribute (already delivered to applications in the nodes 102, 104, 106, 108) may be used. In other embodiments the ProxyMADcommand attribute is implemented by marking an attribute such that it is processed by the host channel adapters and the marked attribute is delivered to the application 142 that is performing discovery and configuration.

Associated with the attribute 202 are payloads 204 for the management datagram 200. The payload 204 may include indicators and/or data structures corresponding to the number of hops 206, a hop counter 210, a source to destination route 210 that may comprise a direct route, and other parameters 212.

The number of hops 206 indicates the number of hops the management datagram is to be forwarded in the switchless network. The hop counter 208 indicates the number of hops executed, i.e., number of hops already forwarded. The source to destination route 210 indicates a direct route for management datagrams among nodes.

FIG. 3 illustrates a flowchart 300 that shows the configuring of an attribute of a management datagram for transmission across a plurality of nodes in a switchless network, in accordance with certain embodiments.

Control starts at block 302 in which a network driver 134 of a first node 134 in cooperation with the discovery and configuration application 142 configures (or does not configure) the proxyMADcommand attribute of a management datagram 144 to indicate that the management datagram 144 is not be terminated by the host channel adapter of another node. Control proceeds to block 304 in which the network driver 134 of the first node 102 sends the management datagram 146 (corresponds to the management datagram 144) from the first node 102 to the second node 104 via the host channel adapter 110 of the first node 102.

The host channel adapter 112 of the second node 104 receives (at block 306) the management datagram 146. The host channel adapter 112 of the second node 104 determines (at block 308) whether the proxyMADcommand attribute of the management datagram 146 is configured to indicate that the management datagram 146 is not to be terminated by the host channel adapter. If so (“Yes” branch 310) control proceeds to block 312 in which the host channel adapter 112 of the second node 104 transmits the management datagram 146 to the network driver 136, where the network driver 136 may determine whether the management datagram 146 needs further retransmission to another node.

If at block 308, the host channel adapter 112 of the second node 104 determines that the proxyMADcommand attribute of the management datagram 146 is not configured to indicate that the management datagram is to not be terminated by the host channel adapter (as shown via “No” branch 314), control proceeds to block 316 in which the host channel adapter 112 of the second node 104 terminates further transmission of the management datagram 146, and the management datagram 146 is not forwarded to the network driver 136 of the second node 104.

FIG. 4 illustrates a flowchart 400 that shows operations performed on receiving an attribute of a management datagram in a switchless network, in accordance with certain embodiments.

Control starts at block 402 in which a node receives the attribute of a management datagram. The node increments (at block 404) the hop counter 208 to indicate that the management datagram and been transmitted another hop. Control proceeds to block 406 in which the node determines if the hop count value indicated by the hop counter is equal to the number of hops 206. If so (“Yes” branch 407), then the packet destination (i.e., the destination of the management datagram) is local to the node, and commands are executed in the local port of the node. Control proceeds to block 410 in which a reply is sent in response to the configuration of the ProxyMadcommand attribute. The sending of the reply is performed via the port specified at the first entry of a recorded path, and attributes, attribute parameters, reversed path information, and number of hops are embedded in the reply, while at the same time the hop counter has been set to zero.

If at block 406, it is determined that the hop count value indicated by the hop counter 208 is not equal to the number of hops (“No” branch 411) control proceeds to block 412 in which the packet (i.e., the management datagram) is transmitted to the next node via a port that is specified in a direct path location corresponding to the hop counter 208.

FIG. 5 illustrates a flowchart 500 that shows the configuring of an attribute of a management datagram for transmission across a plurality of nodes in a switchless network, in accordance with certain embodiments.

Control starts at block 502 in which a plurality of nodes 102, 104, 106, 108 are maintained in a switchless network, wherein each of the plurality of nodes has at least one host channel adapter 110, 112, 114, 116 for communication. A management datagram that indicates source to destination routes for communication in the plurality of nodes is provided (at block 504). Control proceeds to block 506 in which, an attribute 202 is configured in the management datagram to allow the management datagram to be propagated among the plurality of nodes 102, 104, 106, 108 of the switchless network without being terminated at host channel adapters 110, 112, 114, 116. In further embodiments, the host channel adapters 110, 112, 114, 116 terminate the management datagram at the host channel adapters 110, 112, 114, 116 if the attribute is not configured. In additional embodiments, the management datagram is associated with subnet administration for an InfiniBand network.

Therefore FIGS. 1-5 illustrate certain embodiments in which a new attribute is defined to allow transmission of management datagrams though host channel adapters in a switchless network that may be implemented in accordance with the InfiniBand standard.

FIG. 6 illustrates a block diagram 600 that shows exemplary subnet management attributes in a switchless network, in accordance with certain embodiments.

A PortInfo attribute 602 defined in section 14.2.5.6 of the InfiniBand standard provides port-specific management information and is implemented for every port of a node. The values of some PortInfo components vary by node by and by port within a node.

A NodeInfo attribute 604 defined in section 13.2.5.3 of the InfiniBand standard provides node-specific information including fundamental management information common to all channel adapters (CA), where channel adapters are the source and terminus of packets that traverse a network. The host channel adapters 110, 112, 114, 116 may comprise channel adapters. Since the InfiniBand standard is directed primarily to switched networks the NodeInfo attribute is also capable of providing fundamental management information for switches. However, in switchless network there are no switches and the NodeInfo attribute does not have to provide information for switches. Further details of the PortInfo attribute 602 and the NodeInfo attribute 604 may be found in the InfiniBand standard.

The ProxyMadcommand attribute 606 has been defined as an attribute 202 for management datagrams in FIG. 2. In embodiments in which the ProxyMadcommand attribute 606 is configured, the transmission of packets are not terminated at host channel adapters.

FIG. 7 illustrates a block diagram 700 that shows service level attributes 702, service level to virtual lane mappings 704, and an associated table 706 in a switchless network, in accordance with certain embodiments.

The service level (SL) 702 attribute in the InfiniBand standard (section 3.5.8.1) permits a packet to operate at one of a plurality of service levels. Each packet (e.g., a data packet) may identify its service level, and as the packet traverses the fabric (i.e., a switchless network) the packet's service level is a component in determining which virtual lane to use on the next link. For achieving this, each port has a service level to virtual lane mapping table (SLtoVLMappingTable 706) that is configured.

Further details of the service level 702, the Virtual lanes, service level to virtual lane mapping 704, and the SLtoVLMappingTable 706 may be found in at least sections 3.5.8.1, 3.5.8.2, 14.2.5.8 and other sections of the InfiniBand standard.

FIG. 8 illustrates a flowchart 800 that shows configuration mechanisms in a switchless network, in accordance with certain embodiments. The operations for performing configuration may be performed under the control of the discovery and configuration application 142 that executes in the first node 102, where the first node 102 acts as the master node for the fabric (performing discovery and configuration of the plurality of nodes 102, 104, 106, 108 in the switchless network). There is only a single discovery and configuration application 142 in the fabric that assumes master role and software executing in all of the plurality of nodes 102, 104, 106, 108 are configured to interoperate with the single discovery and configuration application 142. The discovery and configuration 142 may of course execute on another node that is the master node, if the first node 102 is not the master node. A property of a port in the PortInfo attribute 602 may indicate the component that is the master node.

In some embodiments, a single instance of the configuration application exists in the network and it may have master role. In other embodiments, multiple instances of the configuration application may exist, where one instance has a master role and other instances have standby roles. The master instance may be elected through an election protocol, which allows detection of a failed master instance and promotion of one of the standby instances to master status. In one embodiment, a method similar to election of master Subnet Manager instance defined in the InfiniBand standard may be used. In other embodiments, one of the existing methods for electing a node from a cluster of nodes in order to run a service is used to elect the master instance.

When the network driver 134 of the first node 102 that acts as a master node is started, a management datagram is sent to configure the fabric that comprises the plurality of nodes and the interconnections among the plurality of nodes. The configuration mechanism is described in the flowchart 800.

Control starts at block 802 in which the discovery and configuration application 142 assigns an address to each of two sides of a link. Control proceeds to block 804 in which the PortInfo attribute 602 of the InfiniBand standard is used to match link parameters and to set addresses.

From block 804 control proceeds to block 806 in which if it is needed then the discovery and configuration application 142 sets VL arbitration tables and SL to VL mappings by using data structures such as service level 702, SL to VL mapping 704, SLtoVLMappingTable 706, etc., as shown in FIG. 7. As a result, the switchless network may operate at a desired service level (SL) [i.e., at a desired quality of the service] in accordance with the InfiniBand standard.

From block 806 control proceeds to block 808 in which the discovery and configuration application 142 moves links to an active state by using the PortInfo attribute 602 of the InfiniBand standard, and subsequent to the completion of operations described in block 802, 804, 806, 808, the switchless network comprising the nodes 102, 104, 106, 108 is configured and operational, and applications in the switchless network start working (at block 810).

It should be noted that while performing the operations shown in blocks 802, 804, 806, 808, 810, the ProxyMADcommand attribute 202, 606 is used (as shown via reference numeral 812) for components that are not directly attached in the switchless network. For example, in case of components that are nodes 102, 104, 106, 108, where the nodes are attached to each other via host channel adapters 110, 112, 114, 116, then the communication among the nodes 102, 104, 106, 108 for configuring the switchless network is performed via the use of the ProxyMADcommand attribute 202, 606 to allow datagrams to be transmitted through the host channel adapters 110, 112, 116, 118. If the ProxyMADcommand attribute 202, 606 is not available in the switchless network, then the switchless network cannot be configured in accordance with the InfiniBand standard.

FIG. 9 illustrates a flowchart 900 that shows configuration mechanisms in a switchless network. The operations shown in FIG. 9 may be performed at least by the discovery and configuration application 142 in cooperation with the network driver 134 that executes in the first node 102 that may comprise a master node of the plurality of nodes in the computing environment 100.

Control starts at block 902 in which a processor initiates an execution of a network driver 134 in cooperation with the discovery and configuration application 142 in a first node 102. The first node 102 comprises a master node of a plurality of nodes in a switchless network. The network driver 134 configures (at block 904) the plurality of nodes and service level in the switchless network by transmitting management datagrams 146 from the master node, wherein the management datagrams include an attribute 202, 606 that allows the management datagrams to be propagated among the plurality of nodes of the switchless network without being terminated at host channel adapters 110, 112, 114, 116 of the plurality of nodes.

Therefore, FIGS. 1-9 illustrate certain embodiments for configuring a fabric comprising a plurality of nodes in a switchless network that is implemented in conformance with the InfiniBand standard,

Cloud Computing Environment

Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.

Referring now to FIG. 10, an illustrative cloud computing environment 50 is depicted. As shown, cloud computing environment 50 comprises one or more cloud computing nodes 10 with which local computing devices used by cloud consumers, such as, for example, personal digital assistant (PDA) or cellular telephone 54A, desktop computer 54B, laptop computer 54C, and/or automobile computer system 54N may communicate. Nodes 10 may communicate with one another. They may be grouped (not shown) physically or virtually, in one or more networks, such as Private, Community, Public, or Hybrid clouds as described hereinabove, or a combination thereof. This allows cloud computing environment 50 to offer infrastructure, platforms and/or software as services for which a cloud consumer does not need to maintain resources on a local computing device. It is understood that the types of computing devices 54A-N shown in FIG. 10 are intended to be illustrative only and that computing nodes 10 and cloud computing environment 50 can communicate with any type of computerized device over any type of network and/or network addressable connection (e.g., using a web browser).

Referring now to FIG. 11, a set of functional abstraction layers provided by cloud computing environment 50 (FIG. 10) is shown. It should be understood in advance that the components, layers, and functions shown in FIG. 11 are intended to be illustrative only and embodiments of the invention are not limited thereto.

Hardware and software layer 60 includes hardware and software components. Examples of hardware components include mainframes, in one example IBM zSeries* systems; RISC (Reduced Instruction Set Computer) architecture based servers, in one example IBM pSeries* systems; IBM xSeries* systems; IBM BladeCenter* systems; storage devices; networks and networking components. Examples of software components include network application server software, in one example IBM WebSphere* application server software; and database software, in one example IBM DB2* database software.

Virtualization layer 62 provides an abstraction layer from which the following examples of virtual entities may be provided: virtual servers; virtual storage; virtual networks, including virtual private networks; virtual applications and operating systems; and virtual clients.

In one example, management layer 64 may provide the functions described below. Resource provisioning provides dynamic procurement of computing resources and other resources that are utilized to perform tasks within the cloud computing environment. Metering and Pricing provide cost tracking as resources are utilized within the cloud computing environment, and billing or invoicing for consumption of these resources. In one example, these resources may comprise application software licenses. Security provides identity verification for cloud consumers and tasks, as well as protection for data and other resources. User portal provides access to the cloud computing environment for consumers and system administrators. Service level management provides cloud computing resource allocation and management such that required service levels are met. Service Level Agreement (SLA) planning and fulfillment provide pre-arrangement for, and procurement of, cloud computing resources for which a future requirement is anticipated in accordance with an SLA.

Workloads layer 66 provides examples of functionality for which the cloud computing environment may be utilized. Examples of workloads and functions which may be provided from this layer include: mapping and navigation; software development and lifecycle management; virtual classroom education delivery; data analytics processing; transaction processing; and the fabric configuration 68 as shown in FIGS. 1-10.

Additional Embodiment Details

The described operations may be implemented as a method, apparatus or computer program product using standard programming and/or engineering techniques to produce software, firmware, hardware, or any combination thereof. Accordingly, aspects of the embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, micro-code, etc.) or an embodiment combining software and hardware aspects that may all generally be referred to herein as a “circuit,” “module” or “system.” Furthermore, aspects of the embodiments may take the form of a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present embodiments.

The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.

Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.

Computer readable program instructions for carrying out operations of the present embodiments may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present embodiments.

Aspects of the present embodiments are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.

These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instruction.

FIG. 12 illustrates a block diagram that shows certain elements that may be included in the nodes 102, 104, 106, 108 or other computational devices in accordance with certain embodiments. The system 1200 may include a circuitry 1202 that may in certain embodiments include at least a processor 1204. The system 1200 may also include a memory 1206 (e.g., a volatile memory device), and storage 1208. The storage 1208 may include a non-volatile memory device (e.g., EEPROM, ROM, PROM, flash, firmware, programmable logic, etc.), magnetic disk drive, optical disk drive, tape drive, etc. The storage 1208 may comprise an internal storage device, an attached storage device and/or a network accessible storage device. The system 1200 may include a program logic 1210 including code 1212 that may be loaded into the memory 1206 and executed by the processor 1204 or circuitry 1202. In certain embodiments, the program logic 1210 including code 1212 may be stored in the storage 1208. In certain other embodiments, the program logic 1210 may be implemented in the circuitry 1202. One or more of the components in the system 1200 may communicate via a bus or via other coupling or connection 1214. Therefore, while FIG. 12 shows the program logic 1210 separately from the other elements, the program logic 1210 may be implemented in the memory 1206 and/or the circuitry 1202.

Certain embodiments may be directed to a method for deploying computing instruction by a person or automated processing integrating computer-readable code into a computing system, wherein the code in combination with the computing system is enabled to perform the operations of the described embodiments.

The terms “an embodiment”, “embodiment”, “embodiments”, “the embodiment”, “the embodiments”, “one or more embodiments”, “some embodiments”, and “one embodiment” mean “one or more (but not all) embodiments of the present invention(s)” unless expressly specified otherwise.

The terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless expressly specified otherwise.

The enumerated listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise.

The terms “a”, “an” and “the” mean “one or more”, unless expressly specified otherwise.

Devices that are in communication with each other need not be in continuous communication with each other, unless expressly specified otherwise. In addition, devices that are in communication with each other may communicate directly or indirectly through one or more intermediaries.

A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary a variety of optional components are described to illustrate the wide variety of possible embodiments of the present invention.

Further, although process steps, method steps, algorithms or the like may be described in a sequential order, such processes, methods and algorithms may be configured to work in alternate orders. In other words, any sequence or order of steps that may be described does not necessarily indicate a requirement that the steps be performed in that order. The steps of processes described herein may be performed in any order practical. Further, some steps may be performed simultaneously.

When a single device or article is described herein, it will be readily apparent that more than one device/article (whether or not they cooperate) may be used in place of a single device/article. Similarly, where more than one device or article is described herein (whether or not they cooperate), it will be readily apparent that a single device/article may be used in place of the more than one device or article or a different number of devices/articles may be used instead of the shown number of devices or programs. The functionality and/or the features of a device may be alternatively embodied by one or more other devices which are not explicitly described as having such functionality/features. Thus, other embodiments of the present invention need not include the device itself.

At least certain operations that may have been illustrated in the figures show certain events occurring in a certain order. In alternative embodiments, certain operations may be performed in a different order, modified or removed. Moreover, steps may be added to the above described logic and still conform to the described embodiments. Further, operations described herein may occur sequentially or certain operations may be processed in parallel. Yet further, operations may be performed by a single processing unit or by distributed processing units.

The foregoing description of various embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto. The above specification, examples and data provide a complete description of the manufacture and use of the composition of the invention. Since many embodiments of the invention can be made without departing from the spirit and scope of the invention, the invention resides in the claims hereinafter appended. 

1-20. (canceled)
 21. A method, comprising: transmitting, via a host channel adapter of a master node of a plurality of nodes, a management datagram to another node of the plurality of nodes; and in response to determining by a host channel adapter of the another node that an attribute of the management datagram is configured to indicate that transmission of the management datagram is not to be terminated by host channel adapters, transmitting the management datagram to a network driver of the another node.
 22. The method of claim 21, the method further comprising: assigning addresses to each of two sides of a link; and using port-specific management information to match link parameters and set addresses.
 23. The method of claim 22, the method further comprising: setting parameters for managing a service level; and moving links to active state by using the port-specific management information.
 24. The method of claim 23, in response to completion of configuring of the plurality of nodes and the service level, applications start working in the plurality of nodes.
 25. The method of claim 23, wherein the port-specific management information comprises a PortInfo attribute in an InfiniBand standard.
 26. The method of claim 23, wherein setting of parameters for managing the service level in an InfiniBand network further comprises: setting virtual lane arbitration tables; and setting service level to virtual lane mappings.
 27. A system, comprising: a memory; and a processor coupled to the memory, wherein the processor performs operations, the operations comprising: transmitting, via a host channel adapter of a master node of a plurality of nodes, a management datagram to another node of the plurality of nodes; and in response to determining by a host channel adapter of the another node that an attribute of the management datagram is configured to indicate that transmission of the management datagram is not to be terminated by host channel adapters, transmitting the management datagram to a network driver of the another node.
 28. The system of claim 27, the operations further comprising: assigning addresses to each of two sides of a link; and using port-specific management information to match link parameters and set addresses.
 29. The system of claim 28, the operations further comprising: setting parameters for managing a service level; and moving links to active state by using the port-specific management information.
 30. The system of claim 29, in response to completion of configuring of the plurality of nodes and the service level, applications start working in the plurality of nodes.
 31. The system of claim 29, wherein the port-specific management information comprises a PortInfo attribute in an InfiniBand standard.
 32. The system of claim 29, wherein setting of parameters for managing the service level in an InfiniBand network further comprises: setting virtual lane arbitration tables; and setting service level to virtual lane mappings.
 33. A computer program product, the computer program product comprising a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code configured to perform operations, the operations comprising: transmitting, via a host channel adapter of a master node of a plurality of nodes, a management datagram to another node of the plurality of nodes; and in response to determining by a host channel adapter of the another node that an attribute of the management datagram is configured to indicate that transmission of the management datagram is not to be terminated by host channel adapters, transmitting the management datagram to a network driver of the another node.
 34. The computer program product of claim 33, the operations further comprising: assigning addresses to each of two sides of a link; and using port-specific management information to match link parameters and set addresses.
 35. The computer program product of claim 34, the operations further comprising: setting parameters for managing a service level; and moving links to active state by using the port-specific management information.
 36. The computer program product of claim 35, in response to completion of configuring of the plurality of nodes and the service level, applications start working in the plurality of nodes.
 37. The computer program product of claim 35, wherein the port-specific management information comprises a PortInfo attribute in an InfiniBand standard.
 38. The computer program product of claim 35, wherein setting of parameters for managing the service level in an InfiniBand network further comprises: setting virtual lane arbitration tables; and setting service level to virtual lane mappings. 